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METHOD AND DEVICE FOR INSERTING AND AUTHENTICATING 
A DIGITAL SIGNATURE IN DIGITAL DATA 

BACKGROUND OF THE INVENTION ' 

1. Field of the Invention 

The present invention relates generally to methods and 
devices for inserting and authenticating a digital signature in 
digital data and, more particularly, encoders and decoders for 
inserting and authenticating a digital signature and associated 
data in digital image, video, and audio data. 

2 . Prior Art 

Photographs, music and video are increasingly being 
digitally represented. There are a variety of reasons for this, 
including improved image or audio quality and more economic 
distribution capabilities. However, digital data content owners 
(hereinafter "content owners"), are increasingly aware of the 
associated risks of piracy and considerable effort has been 
directed towards minimizing this risk. Digital watermarking is 
one tool that has received attention for minimizing these risks. 
An early focus was on the design of watermarks that were not 
perceptible yet survived many forms of common signal processing 
such as MPEG- 2 or JPEG compression. 

It is known in the art that there is also a need for 
fragile watermarks, e.g: watermarks that do not survive simple 
image processing operations. The purpose of these fragile 
watermarks is to provide a viewer with an indication of whether 
an image has been tampered with. The integrity of digital images 
is increasingly of concern since many low cost software systems • 
allow very sophisticated image editing capabilities that can 



seamlessly alter an image. Currently, photographs are considered 
excellent evidence to support descriptions of events. However, 
this may change, if widespread "doctoring" of images leads the 
general public to become suspicious of the authenticity of an 
image. 

These issues have also been addressed in the art. The 
solution has been one based on classical cryptography within 
which authentication is well understood. The basic idea behind 
cryptographic authentication is to pass the data through a one- 
way hash function resulting in an N-bit hash. The N-bit hash is 
then encrypted using the private key of a public key encryption 
algorithm to form a digital signature. To authenticate the data, 
the data in question is once again hashed and this N-bit sequence 
is compared with the digital signature that is decrypted using 
the associated public key. 

A disadvantage of the system as it was originally, 
proposed for a image data was the need for two files, one 
containing the image and the other containing the signature. 
Authentication requires the presence of both files, which can be 
a nuisance since it is very easy, for example, to transmit an 
image but forget to transmit the associated signature. Ideally, 
a single file would suffice. An obvious solution would be to 
concatenate the signature into the header of the image file 
format. However, this solution is problematic when images are 
converted between 'various file formats, e.g. tiff, bmp, etc. 

Recently, Wong [P. H. Wong, "A Public Key Watermark for 
Image Verification and Authentication", Int. Conf. On Image 
Processing, 455-459, Oct. 1998] proposed a straightforward way to 
insert a function of the signature into the image itself. Such a 
system has the advantage of being unaffected by changes in image 
file formats and does not need any form of meta-data. 
Authentication is performed on independent' blocks of the image. 
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For each block, X"^, the least significant bit of each pixel is 
set to zero. This modified block is then passed through a hash 
function, together with the original image width and height 
information. The output of this hash function is then exclusive 
5 OR'ed (XOR'ed) with a corresponding set of bits, B^. to form a 
signature, which is public key encrypted such that Cj.=Ej^, (W^,) 
and is inserted into the least significant bit (LSB) of the 
block to form a watermarked image block Y^.. Wong teaches that 
is a binary image or pattern whose dimensions must be less than 

10 or equal to the length of the hash. The purpose of. the XOR is to 
scramble the binary image, B,.. Subsequently, at decoding, the 
LSB plane of each block is decrypted using the associated public 
key and it is XOR'ed with the hash of the block after setting the 
least significant bits of the block to zero. If the block is 

15 authentic, i.e. unchanged, then the result is once again B^., 

i.e., XORing a second time with the same hash value unscrambles 
the pattern B^. Otherwise, the pattern remains scrambled. 
Authentication of the image is performed by visual inspection of 
the patterns, B'^, though in practice, a computer could perform a 

20. bit-wise comparison of B^: and B'^. Strictly, such a scheme only 
authenticates the most significant bits of each pixel since the 
LSB is altered so as to carry the corresponding encrypted 
signature . . 

Others in the art have described situations in which 
25 rightful ownership. could not be resolved by a straightforward 
application of watermarking. In particular, they identified a 
situation in which anyone could claim ownership of a watermarked 
image through a process whereby a counterfeit watermark is 
inserted. They proposed a solution to this problem using a 
30 method called "non- invertible" watermarking. The basic idea 

behind this method is to construct a watermark based on a non- 
invertible function of the original image. An example of a non- 
invertible function is a one-way hash function commonly used in 
cryptography. Such a function takes a string of bits as input 



and outputs a finite, for example/ a 1000-bit output. . However, 
given the 1000-bit output, it is computationally infeasible to 
determine the corresponding input . It should be noted that such 
a watermark can only be read by the content owner or someone in 
possession of the original image or its hashed key. Thus, a 
public watermark, i.e. a watermark that can be read by anyone, 
cannot be non- invertible or, at least, the benefits of non- 
invertiblity are lost since all readers must have knowledge of 
the hashed value. 

Furthermore, authenticating an image that is to be 
subsequently compressed and later decompressed is troublesome 
with the methods and devices of the prior art. Many in the art 
have looked at this problem from the perspective of 
authentication schemes that survive JPEG compression. That is, 
while the digital data has been altered by the lossy compression, 
the image is essentially the same. 

SUMMARY OF THE INVENTION 

In' the methods and devices of the present invention a 
signature is inserted into predetermined bits of digital data for 
authentication of the digital data. Alternatively, both the 
digital data and some associated information are both 
authenticated. This associated information might include 
copyright notices, owner identification, amongst other things. 
This information may be embedded into the image in a variety of 
ways, as have been discussed in the watermarking literature. This 
embedding is performed prior to signing (creating the digital 
signature by hashing and encrypting) . 

In a version of the methods and devices of the present 
invention, we are concerned with the situation in which a 
compression algorithm is well known to the authentication system. 
This approach is applicable to, for example a JPEG compressed 
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image or MPEG compressed video. In particular, the present 
invention is applicable to the problem of authentication within a 
digital camera or other image generation devices, though the 
solution is not limited to such a situation. Digital cameras 
5 with resolutions of IKxlK produce very large amounts of data 
which must be both stored and possibly transmitted from the 
camera to a computer. To expedite this process, it is expected 
that such data will be compressed in order to reduce the storage 
and bandwidth requirements. However, when the image is 
10 eventually decompressed, the viewer must still be able to 
authenticate the image. 

In yet another version of the methods and devices of. 
the present invention not only is digital data signed for 
authentication purposes but it is also time stamped in order to 
15 be able to prove the time of origin. A further refinement of 

this system is to time stamp the image with both time and place 
of the image generation device, the latter information preferably 
being available through a Global Positioning Satellite (GPS) 
receiver . v 

20 Accordingly, a method for inserting a digital signature 

into digital data is provided. The digital data comprises bits, 
and the method comprising the steps of: assigning predetermined 
bits of the digital data for receiving the digital signature; 
signing the digital data excluding the predetermined bits 

25 resulting in the digital signature; and inserting the digital 
signature into the predetermined bits of the digital data for 
subsequent authentication of the digital data. 

Also provided is a method for authenticating digital 
data having the embedded digital signature in the predetermined 
30 bits of the digital data. The method comprises the steps of: 
extracting the digital signature from the predetermined bits; 
decrypting the digital signature from the digital data resulting 
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in a first hash; applying a one-way hashing function to the 
digital data excluding the predetermined bits resulting in a 
second hash; and comparing the first hash to the second hash 
wherein if the first hash matches the second hash the digital 
5 data is authentic. 

. In a preferred version of the methods of the present 
invention, the signing step comprises: applying a one-way hashing 
function to the digital data excluding said predetermined bits 
resulting in a hash; and encrypting the hash. 

10 In yet another preferred version of the methods of the 

present invention, the method further comprises the step of 
inserting associated data into the digital data prior to the 
signing step such that the digital; signature authenticates both 
the associated data as well as the digital data. Preferably, the 

15 associated data is inserted into the bits of the digital data 
excluding the predetermined bits. 

Also provided are encoders and decoders for carrying 
out the methods of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 These and other features, aspects, and advantages of 

the methods of the present invention will become better 
understood with regard to the following description, appended 
claims, and accompanying drawings where: 



25 



FIG. lA illustrates a digital image or an image frame 
of a digital video sequence, wherein the image or image frame 
comprises digital data defining a plurality of pixels. 



FIG. IB illustrates the image or image frame of FIG, 
lA showing the bits comprising each of the plurality of pixels, 
from a most significant bit to a least significant bit. 

FIG. IC illustrates the image or image frame of FIG. 
lA represented as bit planes, from a most significant bit plane 
to a least . significant bit plane. 

FIG. ID illustrates the image or image frame of FIG lA 
in which the digital data is transformed into a frequency domain 
having a high and a . low frequency component. 

FIG. IE illustrates audio digital data represented as 
bit planes, from a most significant bit, plane to a least 
significant bit plane. 

. FIG. 2A is. a flowchart illustrating a preferred method 
of inserting a digital signature into digital data of the present 
invention. , 

FIG. 2B is a flowchart illustrating a preferred method . 
of authenticating- digital data having an embedded digital 
signature in predetermined bits of the digital data. 

FIG. 3 is a schematical illustration of a device for 
signing and/or time stamping- digital data for subsequent 
authentication of the both the digital data and the time stamp. 

FIG. 4 is a schematical illustration of a device for 
inserting data into, a digital having means for receiving the 
inserted data from an external source. 

FIG. 5 is a schematical illustration of a device for 
inserting data into digital data having a recognition means for 
recognizing a user of the device and wherein the inserted data is 
an identifier which identifies the recognized user of the device. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



Although this invention is applicable to numerous and 
various types of digital data, it has been found particularly 
useful in the environment of digital image data generated with a 
digital camera. Therefore, without limiting the applicability of 
the invention to image data or a digital camera, the invention 
will be described in such environment. However, those of 
ordinary skill in the art will recognize that the methods and 
devices of the present invention are equally applicable to 
digital video and digital audio data and any type of digital data 
generation device. 

Before discussing the present invention, a brief 
overview of a digital image will be discussed with reference to 
FIGS. lA-lD. FIG. lA illustrates a digital image 100. . The 
digital image 100 can also be an image frame from a sequence of 
image frames in digital video. The digital image' is represented 
by a. plurality of image pixels 102, one of which is illustrated 
in the lower right corner of the image 100. Referring now to 
FIG. IB, each pixel is defined by a plurality of bits 104, from 
a most significant bit (MSB) 106 most visually perceptible to the 
human eye, to a least significant bit (LSB) 108 least visually 
perceptible to the human eye. As can be seen in FIG. IC, each 
corresponding bit for the pixels comprising the image 100 make a 
bit plane. All of the most significant bits 106 of the image 
pixels 102 comprise a most significant bit plane 110. Similarly, 
all of the least significant bits 108 of the image pixels 102 
comprise a least significant bit plane 112. FIG. IE illustrates 
corresponding digital data from a time series such as audio data. 
The audio digital data is . represented as samples (columns) 124, 
wherein each sample is represented by a most significant bit 106 
down to a least significant bit 108. The rows of corresponding 
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bits are referred to herein as planes, even though they are 
single rows, from a most • significant bit plane 110 to a least 
significant bit plane 112, 

The representation of the image 100 in the order of the 
5 significance of the bits which define the pixels is but one way 
of representing the digital data as the image. Generally, the 
digital data comprises a plurality of samples, each of the 
samples being defined by a plurality of bits, wherein the samples 
are pixels for image data, time samples for audio data, and 

10 spatial temporal samples for video' data. The method would then 
transform the plurality of bits into an alternative 
representation having at least first and second characteristic 
components. The predetermined bits comprise one of the first and 
second characteristic components . If associated data is also to 

15 be inserted, the associated data is inserted into at least a 
portion of the second characteristic component. 

One such way to define the image is to transform the 
digital data into a frequency domain 114 as illustrated in FIG. 
ID. In the frequency domain, the image 100 is transformed into 

20 components of high and low frequencies, 116, 118, resp>ectively . 
The high frequency component 116 being -.less perceptible to the 
human eye than the low frequency component 118. Preferably, the 
predetermined bits comprise a portion of the high frequency 
component and the associated data, if any, is inserted in the 

2 5 remaining high frequency component and/or the low frequency 
component . 

The number of bits needed to sign (insert a digital 
signature) or authenticate the image 100 is very small, 
preferably between 128 and 256 bits. This is especially true 
30 when compared with typical image dimensions of 512x512x24 bits. 
Typically, the digital signature is inserted into the LSB plane 
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because it is the plane which is' least perceptible to the human 
eye. However, it is entirely unnecessary to alter all the least 
significant bits of the image 100, only a portion of the LSB 
plane 120 need be altered by the insertion of the digital 
5 signature.. Thus, a simple signing procedure inserted into the 
portion 120 of the LSB plane provides a basic authentication 
procedure with the minimal alteration of the original image. 

The basic insertion method of the present invention is 
illustrated in some of the steps of FIG. 2A. In step 2.00, the 

10 digital data is provided which defines the digital image (or 
alternatively, digital video or audio). In step 202, 
predetermined bits of the digital data is assigned for subsequent 
insertion of a digital signature. Preferably, the predetermined 
bits comprise at least a portion of the LSB plane 120, however 

15 any portion of the digital data can be assigned as the 

predetermined bits.. The number of the predetermined bits is 
preferably the same as the number of bits in the digital 
signature. However, the number of the predetermined bits can 
alternatively be larger than the size of the digital signature to 

20 allow for insertion of more than one digital signature or other 
data . . 

Next, the digital data excluding the predetermined bits 
is signed resulting in the digital signature. Any signing method 
known in the art can be used without departing from the scope or 

25 spirit of the present invention. Preferably, the signing is 

accomplished by first applying a one-way hashing function to the 
digital data excluding the predetermined bits resulting in a hash 
(or hash value) . This is shown at step 210. The hash is then 
encrypted at step 220 resulting in the digital signature. The 

30 digital signature is then inserted into the predetermined, bits of 
the digital data at step 226. The remaining steps illustrated in 



the flowchart of FIG. 2A are preferable or alternative steps to 
the method previously described. 

The basic method of the present invention for 
authenticating the digital data once the digital signature has 
been inserted into the predetermined bits will now be described 
with reference to FIG. 2B. At step 228 the digital signature is 
extracted, from the known location of the predetermined bits 120. 
At step 230 the digital signature is decrypted from the digital 
signature resulting in a first hash. At step 232, a known one- 
way hashing function which is used to encode the digital data is 
applied to the digital data excluding the predetermined bits 
resulting in a second hash. At step 234, the f irst^^^^kas^ and the 
second hash are compared and there is a determination of whether 
or not they match (step 236) . If the first and second hashes 
match (step 238) the" digital data is authenticated/ if they do 
not match (step 240) the digital data is not authenticated. The 
remaining steps illustrated in the flowchart of FIG. 2B are 
preferred steps corresponding to some of the preferred steps of 
FIG. 2A, which will be discussed below. 

A limitation of this method is that it does not 
localize the region of the image that has been altered. Rather, 
the algorithm simply declares that the image is or is not 
authentic. There are many situations y/here this is adequate. 
However, it is straightforward to extend this approach to a block 
based method in which each block is independently signed. 
Further, the signature need not be placed in the LSB's of an 
image. The key property is that the image is partitioned into 
two disjoint partitions. The first partition must capture the 
key properties that must be authenticated. The second partition 
is a preferably redundant, possibly perceptually insignificant 
region of the image. For example, a frequency based system is 
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also possible in which the image (or subimages) are first 
. transformed into the . frequency domain 114. Next, the low 
frequency perceptually significant components 118 of the image 
100 are authenticated while high frequency (perceptually 
5 insignificant) coefficients 116 are used to hold the digital 
signature. Many other variations are possible, including 
inserting into the least significant bits of the transformed 
domain. 



■Of course, it is well known that changes to the LSB of 

10 almost all images cannot be discerned. Thus, the other least 
significant bits, e.g. (512x512x1 - the number used for the 
digital signature) offer an opportunity to embed or insert more 
information in the image (step 208), referred to herein as 
associated data. Methods of the prior art do not efficiently 

15 utilize these bits since the prior art methods require 

modification of all the least significant bits of a block. An 
alternative version of the present invention is to simply use 
this large set of remaining bits to encode additional information, 
associated with the image. Such information could include, but 

20 is not limited to the photographer ' s name, copyright permissions , 
a public key needed to decrypt the digital signature, a source or 
owner of the digital data such as a photographer who took the 
digital image, and Internet (URL) addresses. Alternatively, the 
associated data 122 can comprise at least two fields 122a, 122b 

25 each having separate data which may be dependent or independent 
from each other. For example, one field 122a may contain data 
identifying a public key needed to decrypt the digital signature 
and the second field 122b may contain data identifying the owner 
of the public key contained in the first field 122a. The content 

30 owner may choose to^ ancpge some of this - information in the clear, 
i.e. unencrypted while other fields may be encoded. 
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Preferably, the associated data is treated as part of 
the image and is signed as well. Thus, not only is the image 
content authenticated but the associated information is as well. 
The associated data is illustrated in FIG. IC as reference 
5 numeral 122 and is preferably inserted into the LSB plane in a 
portion excluding the predetermined bits which contain the 
digital signature. It should be apparent to those skilled. in the 
. art that embedding the associated data .122 in the remaining 
portion of the LSB plane 108 is only a preferable implementation 
10 . of the methods of the present invention, and is given by way of 
example only. The associated data may be embedded in a variety 
of other ways, many of which have been described in the prior 
watermarking art. 

It should be apparent to those skilled in the art, that 
15 the LSB plane exists analogously in other digital content forms. 
Generally, the digital data can be said to comprises a plurality 
of samples, wherein each of the samples are defined by a 
plurality of bits in the digital data, from a most significant 
bit to a least significant bit. In the case of digital- image 
20 • data, each sample is an image pixel, in digital video, each. 

sample is a spatial temporal sample, while in digital audio, each 
sample is a time sample. 

In an alternative version of the insertion methods of 
the present invention, the digital data comprises a plurality of 

25 samples, audio, video, or image. In this alternative, the least 
significant bit plane in the digital data is ignored. The 
associated data is concatenated to the digital data having the 
ignored least significant bit plane. The digital data haying 
concatenated associated data is then signed resulting in the 

30 digital signature which is inserted in the predetermined bits. 
Where ignoring not only means that the least significant bit 
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plane is not passed through the hash, but can also mean that all 
the bits in the LSB plane are set to 0 or 1 or to an arbitrary 
pattern, etc. 

The methods of the present invention are not limited to 
5 signing the entire digital data. Subregions may also be signed. 
However, it should be apparent to those in the art that if the 
signature remains 128 bits in length, then there are 128N bits 
used for signing when the image is partitioned into N blocks. 
Thus, there may be a tradeoff between localization of the 

10 tampering and the amount of additional information that can be 
embedded into the image, especially if the LSB's are used to 
store the associated data and the signatures. In the limit, if 
each subblock only contains 128 pixels, then there is not 
additional capacity available in the LSB plane.. Note, however, 

15 that Wong requires each sub -block to be less than or equal to the 
hash length, while the methods of the present invention 
preferably require each sub-block to be greater than or equal to 
the hash length. 

Despite the very rapid progress in data storage and 
2 0 transmission rates, images still require very significant amounts 
of bandwidth and storage! Consequently, in many cases, the 
content owner will require that the digital data be compressed, 
e.g. JPEG for an image, or. MPEG for video, for economic reasons. 
In such a situation it is desirable to sign the compressed image 
25 and, after decompression, have a signed image. 

Referring back to FIG. 2A, it is first determined 
whether the digital data is compressed at step 204. If the data 
is not compressed, the method follows to sign the digital data as 
previously described. If the digital data is compressed, the 
30 digital data is decompressed at step 206 such that a signature 
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can be computed at steps 210 and 220. The digital signature is 
then be inserted into a header of the compressed file at steps 
222 and 224. Preferably, the decompression algorithm used is 
modified such that after decompression of the image, the 
5 signature present in the header is copied to the corresponding 
predetermined bits of the decompressed image. 

Referring now to FIG. 2B, when the compressed file 
with the digital signature in the header is authenticated, the 
compressed file is decompressed at step 242 and the digital 

10 signature in the header is inserted into the predetermined bits 
of the digital data at step 244. If the digital data also 
contains associated data (step 246, YES decision) , the associated 
data may be inserted in the header at step 224 and into the 
digital data at step 248 after decompression at step 242. 

15 Alternatively, the associated data may be inserted into the image 
prior to compression and in such a manner that the associated 
data survives the compression step. The method for 
authenticating the digital signature (and associated data if 
present) then follows steps 228 to 240 as previously described 

2 0 above. 



Alternatively, the authentication capabilities of the 
methods of the present invention are extended to include time 
stamping which comprises inserting time data into the digital 
data for identifying the time the digital data was created. 

2 5 Referring back to FIG. 2A, the basic procedure for time stamping 

digital data consists of first passing the. digital data through a 
one-way hash function 210 as previously described. If the 
digital data is to be time stamped (step 212, Yes Decision), the 
one-way hash and signature are transmitted to a trusted third 

3 0 party which concatenates the hash, signature, and time data at 

step 214 and passes the hash, signature, and the current 
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time/date (time data) through another round of one-way hashing at 
step 216. This hash is then encrypted at step 218 using a public 
key encryption method and the encrypted signature and time data 
are returned to the content owner. The signature and time data 
5 can again be encoded in some portion of the predetermined bits of 
the digital data at step 226 as previously described. In such a 
manner, it is possible to both prove that the image has not been 
tampered with and to determine a date by which the original 
content must have existed. It should be apparent to those 
10. skilled in the art that any time stamping procedure known in the 
art can be used without departing from the scope or spirit of the 
present invention. 

This arrangement requires a trusted third party, 
stamping organization. Typically, such an organization is 

15 accessible over a network, e.g.. the Internet. However, such a 
configuration is not practical for immediately time stamping 
images generated by an image generation device, such as those 
taken by a digital camera, since the digital camera may not have 
access to the trusted third party.. Referring now to FIG. 3, ah 

20 alternative arrangement is to equip each digital camera or image 
generation device 300 having digital data' generation means 301, 
such as a digital scanner or digital video camera, with a 
semiconductor chip 302 having a tamper resistant clock 304 and a 
tamper resistant time stamping circuit 306 such as a public key 

25 encryption system that can serve the same roll as the trusted 

third party. Such a device 3 00 would preferably have its private 
key embedded in a memory 308 such that it was inaccessible. The 
tamper resistant clock would be set at the factory and also be 
unalterable by any user. Preferably, the corresponding public 

30 key is placed in the clear (unencrypted) within a field of the 

LSB's of the image. The digital data is then signed by a signing 



means 303 using the private key from memory 308. If associated 
data is to be inserted, an associated data insertion means 305 
inserts the associated data into the digital data before signing 
by the signing means 303. The associated data (if any), 
signature, and time stamp (if any) are then supplied to an 
insertion means 307 for insertion of the signature and/or time 
stamp resulting in signed and/or time stamped digital data. 



information other than time. For example, referring to FIG. 4, 
it is possible that image generation devices 300. also be equipped 
for receiving data such as the associated data, from an external 
source 402, such as a GPS (Global Positioning Satellite) 
transmission with a reception means 404 such as an antenna. In 
such circumstances, it is possible to verify not only the time 
the digital data was created, (e.g., the. time the photograph was 
taken) but also the location. In such a method the image 
generation device 3 00 would receive the data to be inserted, 
preferably an RF (radio frequency) transmission such as from a 
GPS transmission, insert the data into the digital data, and then 
authenticate the digital data as well as any associated data 
inserted therein as previously described. The external source 
can also be an internet link 406 in which the image generation 
device 400 is linked with a personal computer 408 having access 
to the internet 408 and capable of receiving the data 
transmission from an internet site. The data can be downloaded 



the digital camera or other image generation device 300 via a 



memory card slot or through a cable interface 412 connected to 
the personal computer 408. 



Such tamper resistant hardware could also provide 




In the case of digital cameras or other digital content 
creation devices, authentication and time stamping require the 
use of a public key encryption system. The device encrypts the 
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signature and/or time stamp using the camera's private key. The 
reader must then have knowledge of the corresponding public key 
in order to, say, authenticate the image. However, there are 
potentially millions of such devices in existence. One important 
5 . use for the LSB's of an image is to hold the corresponding public 
key of the device, such as a camera so as to enable 
authentication. However, at this point all that can be confirmed 
is that a specific camera captured the image. The viewer does not 
know who took the photograph. 

10 In an alternative version' of the methods of the prior 

art, this knowledge can also be provided by allowing the 
photographer (user) to program his/her camera (image generation 
- device) with his/her name and public and private keys. The 
photographer's name, say Adam, and public key may be placed in 

15 the clear in a. field within the LSiB's of the image (digital data) 
that are also authenticated. The image, together with all the" 
LSB's except those that are used to store the signature are then 
first signed by the camera using its private key. Next this 
signature is encrypted using the photographer's private key. 

20 Several levels of signing are possible. This allows 

the image to be signed by the camera (indicating that the data 
has not been processed subsequent to its recording from the CCD 
array), the photographer (identifying the person responsible for 
the image) , the distributor, etc. However, earlier levels of 

25 signing must leave bits available to accommodate the next level 
signature and possible associated data. For example, a digital 
camera might sign all the image bits except the LSB plane and 
insert its signature into a predetermined field in the LSB plane. 
Next, the photographer (either within the camera or on a PC) 

30 might insert associated data into other fields of the LSB plane 
and then sign these fields together with the signature from the 
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camera. This second signature would be placed in another 
predetermined field of the LSB plane. Other iterations are 
possible, provided there is space remaining in the predetermined 
bits to store the signature. Note that the photographer signed 
5 the associated data and the camera's computed signature. This is 
sufficient to know that the photographer took the. image, even 
though the second level of signing did not explicitly sign the 
image. However, this is an alternative method but is not the 
' preferred embodiment since the hashing of the image data a second 
10 time is unnecessary given the signature from the camera. 

Referring now to FIG. 5, a further refinement to 
programming the camera with a photographer's public and private 
keys would involve equipping the digital data generation means 
3 00, i.e., camera, with a recognition means 502 such as a 
15 biometric". identification system like a low cost fingerprint 

recognition system. The camera could then be programmed with the 
information of several photographers and would select the correct 
one based on the fingerprint of the person holding the camera 
300. 

20 In other words, the image generation device 300 as 

illustrated in FIG. 3 having digital data generation means 301 or 
other encoding device, would additionally have the recognition 
means 502 and the memory 308 would further store an identifier 
corresponding to each of at least -one user of the device in one 

25 field 308a of the memory 308. The identifier is preferably a 
name, of the photographer or other identifier such as a social 
security number. Preferably, a private key associated with each, 
user is stored in a second field 308b in the memory 308. The 
recognition means 502 recognizes one of the users whose 

30 identifier is stored in the first field 308a of the memory 308. 

The identifier corresponding to the recognized user is output to 
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the associated data insertion means 305 as associated data. 
Preferably, the recognized user's private key is output from the 
second field 308b of the memory 308 for use by the signing means 
3 03 to sign the digital data,, so that one can guarantee that the 
5 data. (image) was never doctored or manipulated by secondary 

processing. As in the embodiment of FIG. 3, the associated data 
(if any) , the time stamp (if any) , and the signature are supplied 
to the insertion means 307 for insertion of the signature and/or 
time stamp resulting in signed and/or time stamped digital data. 

10 However, the digital data can also be signed after subsequent 
processing, such as in a P.C, In the case of a digital image 
taken. by a digital camera, the digital image can first be loaded 
into a P.C. and manipulated with standard software known in the 
art, and then signed, wherein the manipulated image is 

15 subsequently authenticated. 

Note that while the preferred embodiment has this 
second round of encryption occurring within the camera, this is 
not essential. For example, the image signed by the camera could 
be downloaded by the photographer onto a PC where an application 

2 0 program would perform the second round of encryption. In fact, 
for digital cameras that do not support authentication, all of 
the above procedures could be performed offline by a PC. The 
benefit of a camera based system is that the authentication is 
performed automatically after each photograph is taken. However, 

25 it is apparent that the photographer could be responsible for 
signing his work using a PC and associated software. 

A viewer first decrypts the signature using the 
photographer's public key, available in a field within the LSB's 
of the image. This result is then decrypted using the camera's 
30 public key, also available within a field of the LSB's of the 

camera. At this point, the decrypted signature can be compared 
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with the hash of the image and data to determine the authenticity 
of the whole. 

Assuming that the authentication is positive, the 
viewer at this point only knows that someone claiming to be Adam 
5 was the source of the image. However, there is nothing to 

prevent someone from impersonating Adam. One last step, therefore 
remains to be absolutely certain that the photographer is indeed 
Adam. The viewer must verify that Adam's public key is indeed 
Adam's. There are a variety of ways that this can be 

10 accomplished. For example-, a trusted third party might provide a 
database listing photographers and their associated public keys. 
Such a database might be provided by a not-for-profit 
professional photographic body or commercial* entity. Such a 
database might be online and/or periodically published much like 

15 a telephone directory. A less centralized solution might involve 
accessing the homepage of Adam on the Internet, where his public 
key would be printed. Of course, the impersonator would also be 
aware of Adam's public key. However, since he does not know 
Adam's private key, it is impossible for him to correctly encrypt 

20 the signature. This is the great strength of public key 
encryption systems. 

A further refinement of the system can be developed 
when it is realized that a photographer may have many cameras. 
In such a situation, the photographer may desire that all cameras 
25 owned by him use a single private key associated with the 

. photographer. This is in contrast to an individual key for each 
camera. Nevertheless, the tamper resistant chip could also 
include the serial number of the camera, thereby identifying 
which of the photographer's cameras actually took the picture. 
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It should also be apparent that while this description 
has focused on still images, the methods are also applicable to 
video, audio and multimedia forms of content. 

While there has been shown and described what is 
5 considered to be preferred embodiments of the invention, it will, 
of' course, be understood that various modifications and changes 
in form or detail could readily be made without departing from 
the spirit of the invention. It is therefore intended that the 
invention be not limited to the exact forms described and 
10 illustrated, but should be constructed to cover all modifications 
that may fall within the scope of the appended claims. 



